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ECS Talk: 
The future evolution of Windows Engineering 


Dave Probert, Development Lead, Windows Kernel 
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Windows 


Windows is the best business in the world 
We have incredibly talented people 
We are leaders in software innovation 
We make a lot of money 
We are fulfilling the vision of empowering ordinary people 
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Windows 


Windows is the best business in the world 
We have incredibly talented people 
We are leaders in software innovation 
We make a lot of money 
We are fulfilling the vision of empowering ordinary people 


But we are victims of our own success 
It is “the world against Microsoft” 
Monetization of software innovation under attack 
Growth is hard to maintain 
Customer expectations are higher than ever 


Windows is scaling 
Windows engineering is not 


Windows is too complicated 
Development is disconnected from customers 
Our quality mistakes are too costly 


Our product development processes are inadequate 
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Windows is scaling 
Windows engineering is not 


Windows is too complicated 
ARCHITECTURE 

Development is disconnected from customers 
SCENARIO-DRIVEN 

Our quality mistakes are too costly 
TOOLS 

Our product development processes are inadequate 
FORMALIZE 
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The Winchester Mystery House 
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WinchesterMysteryHouse.com/story.html 


Іп 1884, a wealthy widow named Sarah L. Winchester . 
began a construction project of such magnitude that it 
was to occupy the lives о] SEDE and craftsmen until 
her death thirty-eight HE later. The Victorian mansion, 
designed and built by the Winchester Rifle heiress, is filled 
with so many unexplained oddities, that it has come to be 
known as the Winchester Mystery House. Sara 
Winchester built a home that is an architectural marvel. 
Unlike most homes of its era, this 160-room Victorian 
mansion had modern heating and sewer systems, gas 
[ШЕ that operated by pressing a button, three working 
elevators, and 47 fireplaces. From rambling roofs and 
exquisite hand inlaid parquet floors to the gold and silver 
chandeliers and Tiffany art glass windows, you wil 
chandel d Tiffany art gl. dows, you will be 
impressed by the staggering amount of creativity, energy, 
and expense poured into each and every detail. 
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These stairs that lead to 
the ceiling are just one of 
the many bizarre features 
that Mrs. Winchester 
designed and had built. 
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Amazing Facts 


• Number of rooms: 160 
+ Number of stories: prior to 1906 seven; presently four 
» Number of acres: originally 162; presently 4 

+ Number of windows: frames 1,257 


А 
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Why did she keep adding on? 


“Some say she thought building the house would prevent 
her death or appease the spirits of the many killed by 
the Winchester rifles that built her fortune. 


http://gocalifornia.about.com 
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Architecture 


Encarta: The design, structure, and behavior of a 
computer system, microprocessor, or system program, 
including the characteristics of individual components and 
how they interact. 
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Understand the problem you are solving 
Devise solution as components 

Identify changes to existing components 
Respect layering and component boundaries 
Fear complexity and dependencies 
Understand the system before you change it 
Be sure your scenarios are sufficient 

Review before you commit 
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Binary Components 


Atomic unit of distribution, servicing & binding characteristics 


Has resources (file, registry, etc) 

Components can contains multiple files and/or registry entries 
Depends on other components & features 

Exposes configurable properties 


Component Manifest XML includes extensions for: 
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Settings Schema and Default Values (WMI.Config) 
Privacy information 

Event information (Crimson) 

Perf counters/probes (WMI.Monitoring, Perfcounter team) 
Monitoring rules (WMI.Monitoring) 

Security information (CLR, SAFER, Windows Security) 
Shell Tasks/File extensions etc. (Shell team) 
Web-deployment information (Fusion/ClickOnce team) 
MUI information 

Natural User Interface/natural language query (NUI team) 
Game information (Games team) 
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Source-level Componentization 


Component: logical collection of functions/features 
that work together using internal state or common 
internal functions 


• Well-defined, completely specified interfaces, 
protocols, and dependencies 


• Behavior defined by test code 
aSource-level components are not binary modules 
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Minimal Windows 
The Base of Componentization 


+ MinWin is the core OS functionality common across all Windows 
platforms with minimum hardware requirements. 


* Windows products built by adding components to MinWin. 
• Base testing platform. 
* Features: 
+ Footprint: 32MB Storage, 64MB RAM 
+ Kernel: PnP, Power Management, WMI 
* preserve investments made in device drivers 


+ Basic Win32 API: Kernel32.dll, User32.dll, GDI32.dll, subset of 
Advapi32.dll (registry, service mgmt.) 


+ Basic Networking: WinSock 2, TCP/IP, DNS client, DHCP client 
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MinWin Architecture 


System Layering 


(Applications 
Frameworks. 
GUI applets New Ul 


Non-GUI applets 


Win32 (kemela2 

Core services (smss, csrss, Isass, winlogon, terminal services) 

Core interfaces (ndi, language run-times 

[win32K 

[Drivers [ NewDrver | 
[Kemer 
[Har 
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Windows vs Linux 


Linux said to be more agile: 
* Windows 


СЕЗЕ 
. Реудортеле process: centralized, large common platform (Windows, 


о e gro, tar 


• Linux (Open Source movement) 
+ Developer СИНЕЕ dependencies ial Еее to use, 


аге 
minimize дере! to maximize installation and use. 
. rs nen proces: massively distributed, small common platform 


Е 
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Deep т the yogurt 


+ Customer satisfaction is amazingly low 
* Vision has raced ahead of quality 
* We don't build complete solutions 
* We blamethe customer 
+ Success raises expectations 
+ We are moving up the food-chain 
* Server customers expect solid engineering 
+ The PC-centric lifestyle raises the stakes 
* Victims of our own success 
+ We аге the target 
• The PC Ecosystem is uncontrollable 
“ Our complexity is unmanaged 
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Jim Allchin: December 1996 
It is everyone's responsibility to think about simplifying our 
software and improving its quality. 


Having just spent dedicated time talking to customers, it is 
clear that this is our single biggest area for improvement. 


Regardless of what product you work on or you specific 
discipline, you need to raise your standards on what is 
acceptable for customers. 


Adding more and more features is not the answer. 


Whether at home or at work, people are frustrated with our 
software. 


It is too hard to use and too fragile. 
We own changing this. 
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Customer connection for developers 


Experience the system as customers experience it 

Install software at home 

Spend holidays helping friends & family 

Use the same diagnosis/support tools as PSS 
Overcome the 99/1 rule 

Engineers are geeks! Normal people don't care. 
Talk to customers 
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Linux learnings 


What we get so far 

+ Importance of community 

» Advantages of componentization and composability 
+ Open source (sort-of) 

What we still need to get 

+ Distributed, darwinian development process 

+ Resonance with systems programmers 

+ Transparency 
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Winning over systems programmers 


Why I dislike Windows 
* The Win32 API is poorly designed 
+ Windows is opaque 
+ Windows is inherently unstable and complex 
+ Windows doesn't get manageability 
+ Windows is GUI-oriented 
+ Windows licensing is PC-oriented 
+ Windows has an impoverished heritage 
+ We don't (can't) use Windows as our customers 
use it 
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Winning over systems programmers 


What I like about Windows 
+ The NT core is sophisticated and powerful 
+ The system is extensible (without source) 
+ NTis notunix 
+ The vision of empowering ordinary people 
+ Hundreds of millions of customers 


33 


Winning over systems programmers 


Why? 
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The 85% problem 


100% 
85% | d 
Commoditization 
096 
ж 
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The Technology Map project 
http:/ /MapsServ 


100% -- Business Capabilities needed to 
provide 100% customer solution 


Solutions Architect 


Microsoft Technological Capabilities 


Windows, Office, SQL, Exch, Web, VS, ... 
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Т-Мар: Data I/O Model 
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T-Map: Current Taxonomy 


‘Applications 
Axapta SPS 
Messaging Services 
= -NET Framework 
pplication Infrast АБ 
interprise System BizTalk 
‘SMS 
мом 
АррСетег 
Data Base Infra 
Sar Networking 
Shell 
Developer Tools 
File Systems 
OS Services Graphics 
OS Kernel 
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What is the difference between а 
programmer and an engineer? 


Engineers run closed-loop 
+ Measure effectiveness 
+ Improve processes 
. Always learning 
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What is the difference between a 
programmer and an engineer? 


Engineers run closed-loop 
+ Measure effectiveness 
+ Improve processes 
. Always learning 
Programmers run open-loop 
+ Answer is always: write more code 
* History doesn't matter 
+ Future doesn’t matter much either 
If Windows was a bridge... 
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The solidification of Windows 


Windows 2000 
+ Solid against crashes (Windows components) 
Windows XP 
* Compatibility 
Windows Server 2003 
+ Solid against attacks 
Longhorn 
- Solid against 3 party drivers 
• Solid against hangs 
+ Less fragile 


44 intemal Technical Education 


Quality through Tools 


• Customer connection (OCA, Watson, ATR, reliability) 

* PREfix, PREfast 

+ Driver Verifier, App Verifier 

Diagnosis (event tracing, Crimson) 

• Test automation (code coverage, SelectTest, Archon, 
WCIT) 


• Magellan (Echelon, Injector, Sword) 

• Device Driver simulator (behavioral modeling) 
+ Process automation (SWT) 

• Common test criteria 

+ Monad 


А 
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Team Size (dev/test) 


Product Dev Team Size Test Team Size 
NT3.1 200 140 

NT 3.5 300 230 

NT 3.51 450 325 

NT 4.0 800 700 

Win2k 1400 1700 

TODAY 2800 2200 
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Product Development Process 


Business Planning Process 
Market Strategy Development Process 


Product Planning Process 


End of Life Process ^ 
b 
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Project Lifecycle Guidelines 


The project lifecycle guides the team throughout the development of 
the project through consistent definitions and milestones/phase 
gates for better communication. It does not define the 
methodology/approach to achieve the phase gate/deliverable. 


The definition of a project is that it has a definite beginning and a 
ДЕЕ end. There should be CLEAR entry and exit points to each 
phase. 

There should be no more than 4 or 5 phases to a lifecycle. The 
lifecycle should be simple enough to be a team’s mantra. 
“Planning” is generally not used for a lifecycle phase. Planning 
should occur throughout the lifecycle as deliverables are continually 
revisited. 

Words like “ongoing” as the last phase is generally not 
recommended as it does not indicate an end point to the project. 
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BusinessPlanning Process 


Project Lifecycle Framework 


“Markel Opp Doc(MOD) 
“Market Reqs Doc (MRD) 


Project Lifecycle Process 


for Mantptace Validation 
‘Occurs within the Implementation 


Product Definition 


Requirements| Design ification | Release 


Process 


Ф Vision Memo 


слез 
ы Architectural Doc! 


Ф Scenarios oe 


Market Strategy 
DevelopmentProcess 


“Go To Maret Stategy Doc 
“Positioning Framework 
"Competitive Analysis Doc 


SL 


Feature Proposal Ф DocPlans сет Ф Betas PI 
те 
Ф лоза dey Pas Sabiteaton | rwaTes — Фитияти 
ырл боор» | Соза comple 
леген) rei em M shouid nave no deign wo det 
жайлана woa win m 
Ф Locnizston Reas Ф Soredue soma degres cta to = 
ноен Report 
Alpha, IDW, IDX, Design Previews, Ф Transition td 
отары Previas gear ana Samang 
зоте 
Phase Gate Reviews: 1040407 
Ф Prase Ф mee ФИ mz в мн 
Review review он са Om Cipt 


Change Management Process In Effect 
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Make it so! Companies 


- Customer is king 

• Inherently top-down 
• Vision rules 

+ What you can imagine drives what you attempt to do 
• Examples 

+ Apple computer 

+ Ford/GM/Chrysler 

+ Microsoft 
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Challenge for Windows? 


Bottom-up engineering 
ina 
top-down company 


